Effect of feedback on the control of a two-level dissipative quantum system 
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We show that it is possible to modily the stationary state by a leedback control in a two-level 
dissipative quantum system. Based on the geometric control theory, we also analyze the effect ol 
the feedback on the time-optimal control in the dissipative system governed by the Lindblad master 
equation. These effects are reflected in the function Aa{x) and Ab{x) that characterize the optimal 
trajectories, as well as the switching function <E>(t) and 6{t), which characterize the switching point 
in time for the time-optimal trajectory. 
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I. INTRODUCTION 

The problem of controlling quantum systems has been 
an important scientific and technological challenge f7\ 
since the discovery of quantum mechanics more than a 
century ago. Numerous approaches to the control of a 
quantum system have been proposed in the past decades, 
which depending on how the controls enter the system, 
can be divided into two categories: the open loop scheme 
(coherent control) and the closed loop scheme [2, [3, 0, ■ 
In the open loop scheme the control functions are fixed, 
namely they can not be modified according to the state of 
the quantum system. Whereas in the closed loop scheme, 
the control functions are updated in real time by feed- 
ing back some information about the actual state of the 
system^6, 7, 8,, i ^j, t his scheme is called quantum feed- 
back control [IQIIiiL IT^ [l3l |. Quantum feedback con- 
trol may emerge as a natural possible route to develop 
strategies to prepare entangled states and prevent their 
deterioration 14 1 in controlled open systems [isj. 

For a real-world quantum system, the coupling of the 
system to its environment is unavoidable. Because of 
this unavoidable coupling, the system dynamics is sub- 
ject to irreversibility, dissipation, and dephasing. As a 
consequence, some appealing properties of quantum sys- 
tems, for example entanglement, are usually lost during 
the time evolution, leading to many typical manifesta- 
tions of this irreversibility, for example the relaxation 
of the system to a stationary state. This fact naturally 
gives rise to the following question, to what extent it is 
possible to modify the stationary state by the controls? 
For open loop control, a previous study [1| shows that 
the stationary state can be modified by indirect control 
through coupling the open system to an auxiliary two- 
level system. What about the closed loop control? can a 
feedback affects the stationary state of the system? 

On the other hand, active research has been performed 
for manipulating an open system with more realistic sit- 
uations taken into account. Although the controls can 
not fully compensate the effect of decoherence for an 
open system governed by the Lindblad master equation, 
as shown in Ref . |la | . an efficient control can still be 
achieved P^tI ll§L Il9l|. These analyses are based on the 



numerical optimalization techniques, and it seems that 
only controls can be achieved by these numerical meth- 
ods. By the geometric control theory, quantum system 
with few levels (e.g ., two- or three-level systems) can be 
formulated (20l . l2l| analytically. This analysis [2l| is for 
the time-optimal control of a dissipative two-level quan- 
tum system without feedback. In this paper we put for- 
ward the study of the control by taking the feedback into 
account, a two- level system governed by the Lindblad 
master equation will be chosen to detail the analysis. 

The paper is organized as follows. In Sec. II, we spec- 
ify the dynamical settings considered in this paper, and 
study the effect of feedback control on the stationary 
state of the system. By using the Pontryagin maximum 
principle, the time-optimal control of a two-level dissi- 
pative system with a feedback control will be studied 
in Sec. III. Conclusion and discussion are presented in 
Sec. IV. Analytical solutions to the system are given in 
the Appendix. 



II. RELAXATION TO STATIONARY STATES 
OF A TWO-LEVEL DISSIPATIVE SYSTEM 
WITH FEEDBACK 

In this section, we shall show that a Markovian feed- 
back scheme based on the continuous monitoring of quan- 
tum jumps, can lead to an improvement of control of 
the stationary states. Before investigating the influence 
of feedback on the stationary states, let us first briefly 
analyze the case without feedback. To start with, we 
consider a two-level system with the free Hamiltonian 
Hq and the control Hamiltonian Hi (with a control field 
u). Within the Markov approximation for the system- 
environment interaction, the time evolution of the two- 
level system is described by the Lindblad master equa- 
tion, ~ —i[H, p] +T{a^ pa^ — icr+o-^p— ^pa^a~) + 



-/{a+ pa- - ^a- C7+ p- ^pcj- Here H = Hq+uHi^; 
(^z = |e)(e| - a- = |5)(e| and cr+ = |e)(5| are 

the Pauli matrices. F = (n -f 1)k and 7 — uk. We de- 
note by n the noise intensity of the environment, and 
K the spontaneous emission rate of the two-level sys- 
tem. |e) and \g) stand for the excited and ground 
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2^3 — (T+j}^+i6\u\^ ■ Therefore it is possible to manipulate 
the stationary state by using the open loop control uHi , 
but it can not compensate fully the decoherence effect, 
for instance with specific T and 7, we can not reach all 
states through relaxing the system to its equilibrium. 

Taking the cavity QED system as an example, we now 
introduce the description of the measurement and feed- 
back scheme, this is schematically shown in figure [1] The 
cavity output is monitored by a photon detector D whose 
signal provides the input to the application of the closed- 
loop control Up. Note that we have two controls in this 
scheme, one is the open-loop scheme corresponding to the 
control Hamiltonian uHi , and another is the closed- loop 
control denoted by Up- The feedback control Up '^s trig- 
gered immediately only after a detection click, namely a 
quantum jump occurs. This scheme was used to generate 
and protect entangled steady state in cavity QED system 
p^ . The master equation for our system reads [lo| . 



r 



FIG. 1: (Color online) Schematic illustration of the feedback 
control and the open loop control. The system consists of an 
atom simultaneously driven by uHi and a feedback Up- This 
feedback is conditioned on the measurement of the output of 
the leaky cavity. 



states of the two-level system, respectively. Choosing 
uHi — u*\g){e\ + u\e){g\, we obtain the stationary state 
of the dissipative two-level system (setting u — ui + 11*2) 

1 — X3 Xi + iX2 



Po 



Xi - iX2 1 + X3 



, where 
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+ 7(o-+/9(T 
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-(7 a ' p - -pa cr 



(3) 



xi = 



X2 = - 



X3 



4:U2X3 
r + 7' 

Auixs 



(r2-72) 



8|u|2 + (7-}-r)2' 

and X — (xi, X2, X3) was defined by 

xi = 2Repeg, 
X2 = 2lmpeg, 

■^3 ^ Pgg ~ Pee- 



(1) 



(2) 



Two observations can be made from Eq.(IT]). (I) The 
control field u drastically changes the stationary state, 
and xi = X2 = when u = 0; (2) X2 and xi are propor- 
tional to 2:3, considering xf 



■ X2 



x^ < l; wc thus have 



The jump feedback Upu^ pa^U]^ can be understood as 
follows. The unitary operator Up is applied only im- 
mediately after a detection event, which is described by 
the term a~ pa^ . Intuitively the stationary states depend 
on the feedback operator Up. So, once the measurement 
prescription has been chosen, the freedom to design a 
feedback to produce a stationary state lies in the differ- 
ent choices for the feedback operator Up. Although an 
enormous range of possibilities for Up is allowed, even 
considering the limitations imposed by experimental con- 
straints, we here choose (with the constraint UpUp = I) 



Up = aca; + bay + caz 



(4) 



In fact the feedback Up written in this form covers all 
allowed possibilities. By Setting p = 0, we arrive at the 
stationary state. 



4r(-»i/2 + U2fi) + (7 + r)(7 - r|[/f 
4mi(-2ui - r/2) - 4u2(2ii2 - r/i) - (7 + r)(7 + r|[/f p) ' 
i4u2 - 2r/i)x3 + 2r/i 

r-f 7 

(-4ui - 2r/2)a;3 + 2r/2 



where / = Up^Up^ = fi + i/2 was defined with Up = 
{i\Up\j),i,j — e,g. This stationary state differs from that 
in the case without feedback at (I)xi and X2 are not zero 



even if u = 0; (2) x'l and X2 are not proportional to 2:3; 
(3) xl + X2 + x"^, i.e., the trace of p"^ (poo is the station- 
ary state) does not only depend on This indicates 
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that we may change the reachable set of stationary states 
by the feedback control. Mathematically, we have only 
two independent parameters in Eq.([T]), when F and 7 
are fixed, whereas there are (at least) three degrees of 
freedom in Eq.(l5]), matching (beyond) the number of in- 
dependent parameter in the two-level system. 



III. TIME OPTIMAL CONTROL OF THE 
SYSTEM WITH MARKOVIAN FEEDBACK 
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Optimal control theory has a long-standing tradition in 
various fields of physics [23| . To our knowledge, one of the 
first application to a quantum system has been in the field 
of quantum chemistry [sl . Recently, optimal control the- 
ory has been extended to dissipative systems [13, HH HI] . 
In this section, we consider the time-optimal control of 
a dissipative two-level system described by the master 
equation ^ . This problem was studied in Ref. [2l[ with- 
out feedback, here we will focus on the effect of the feed- 
back on the time optimal control of this system. With the 
notations in Eq.Q, the master equation can be written 
as, 

xi = 2^2x3 - ^—^.Ti + r/i(i - xs), 
r + 7 

X2 = -21*1X3 2:2 -I- r/2(l - X3), 

X3 = 2uia:2-2u2Xi-X3(7 + r|C/f p)-(7-r|{/f n. 

(6) 

As defined in Eq.([2]), xi,X2, X3 are three real parameters, 
while u is a complex function u = u(t) = ui{t) + iu2{t), 
and / — Uy^Uy = fi -\-if2 is a complex number. As the 
most important tool for the study of optimal control, the 
Pontryagin maximum principle (PMP) provides a first 
order necessary condition for optimality. In the follow- 
ing we shall analyze the optimal control of this two-level 
system by applying the PMP. The analysis of the opti- 
mal control on R'^ manifold is considerably complicated. 
To simplify the study, we restrict the dynamics to a sub- 
manifold R^ by assuming the control field u is real and 
/i = [2^. With these assumptions, X2 and ^3 are de- 
coupled from xi, leading to 

r + 7 

X2 = -2uiX3 ^2:2 + r/2(l - 2:3), 

X3 = 2uia;2-(7 + r|[/f nx3-(7-r|;7f p). (7) 

To shorten the notation, we omit the index 1 of ui and 
set X = {x2tXz)- Equation ([7]) becomes x = F + uG, 
where 



F = 



-^-^X2 +rf2 -Tf2X3 , 

-(7 + rrc/f p):,3-(7-r|c/f |2) ) 



and 



G = 



-2x3 

2X2 



(9) 



FIG. 2: The sub-manifold of {x2,X3) is divided by Ca = 
A^^(O) (solid lines) and Cb = A~^(0) (dashed lines). T = 
0.6,7 ~ 0.3 were chosen for this plot, (a) and (b) are for the 
case with and without feedback, respectively. 



For each x, we have calculated A 4 (a;) 
Ab{x) = Det{G, [F, G]) defined in ^ 



Det{F, G) and 



Aa(x) 



-2(7 + F|;7^ 



9912-, 



2(7- 



- {1 + T)xl - 2T f 2x2x3 + 2Tf 2X2, 



Ab{£) = 4(7-F|;7f p)a:2+4(7-F 
+ 4F/2a;^-4F/2a;^ + 4F/2X3, 



2r\Ul?\')x2X3 



(10) 



where Aa{x) is useful for studying abnormal extremals, 
and Ab{x) is for detecting singular trajectories. We can 
find from Eq. (fTO|) that the feedback control Up play an 
important role in Aa{x) and Ab{x), which are crucial in 
the time-optimal problem. We denote by Ca and Cb the 
two sets of points A^"^(0) and A^^(O), respectively. Ca 
and Cb are responsible for quantitative modification of 
the optimal trajectories. For Up = 1 (without feedback), 
Aa{x) and Ab{x) reduce to 



AAix) = -2(7 + F)a;2-2(7-F)x3-(7 + r)x2, 



Ab{x) = 4(7-F)x2 +4(7-hF)a;2a;3. 



(11) 



In this case the set Cb consists of the following two lines, 
X2 — and X3 = (F — 7)7(7 -I- F), while the solutions of 
the polynomial equation 2(7 -|- F)x| -I- 2(7 — T)x3 -f (7 -I- 
T)x2 = belong to the set Ca (as shown in figure [21- (b)). 
The two sets Ca and Cb change when the feedback is 
added to the system. This is illustrated in figure [21- (a), 
where we plot Ca and Cb with F = 0.6, 7 = 0.3, / = 
cos f sin f, and C/^^ = cos^ | [2|. Without feedback, 
the sub-manifold of R^ is symmetrically divided by the 
line X2 — 0, as figure [Il-(b) shows. This symmetry is 
broken by the feedback (see figure [T]- (a)), indicating that 
the symmetry in the optimal trajectory disappears. This 
is confirmed by figure [3] where the two trajectories with 
M = ±1 are plotted. Assuming the field u is bounded by 
|u| < 1, we now analyze the optimal control of the two- 
level dissipative system with the constraint of minimizing 
the total time of the control, i.e., time-optimal control. 
The Pontryagin maximum principle tells us that for the 
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FIG. 3: Analytical solutions to the dynamics with u = 
— l(sohd line) and u = 1 (dashed line), (a) Without feed- 
back, and (b) with feedback. The other parameters chosen 
are T = 0.4,7 = 0.3, and 13 = 0.2n. 



FIG. 5: sgng versus time t. The parameters chosen are the 
same as in figure U Times corresponding to sgne = are 
allowed to switch. This together with figure |4] determine the 
switching points in time. 




Time t 



FIG. 4: Illustration of 0{t) as a function of time. The solid 
line and dashed line represent the case of u = — 1 and u = 1, 
respectively, (a) Without feedback, while (b) with feedback. 
The other parameters are the same as in figure O 



model system considered here, the extremal field u may 
take either —1 or 1 according to u = sgn[^{t)], if <i>(t) ^ 
0, where 

$(t) =p-G= -2^22:3 + 2p3X2 (12) 
with p satisfying 

aij _ r + 7 

dx2 

P3 = -2MP2 + r/2P2 + (7 + r|c/f nP3.(i3) 

If $(t) vanishes on an interval [toi^i]; the corresponding 
control in this interval is u — (f>, where can be calculated 

by 



P2 



-P2 - 2up3, 



H^B = -T. X2 + -T. 2:3 = 0, 

at 0x2 0x3 

leading to 

-^^332:3 + -?f232;2a;3 + K22XI + K3X3 + K2X2 
^^33X3 + K!23X2X3 + K!22xl + X3X3 + K'2X2 



(14) 



(15) 



in our case. Here 


K33 - 


-(r + 7)r/2, 


K23 = 


(7-r + 2r|c/fp)(I + 


K22 = 


(r + 7)r/2, 


K3 = 


(r - 7)r/2, 


K2 = 


(7-r|{/fp)(-£ + |i: 


^33 = 


-2(7-r + 2r|c/f n, 


K'23 = 


-8r/2, 


K'22 = 


2(7-r + 2r|[/|3n, 


K'3 = 


-2(7-r|c/f n. 


K'2 = 


27/2. 
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r|c/f n + 2rV2', 



2r|[/f n 



2rV|, 



(16) 

Notice that if $(t) has no zeros then u is almost every- 
where constantly equal to ±1. Hence we are interested 
in determining when the control may change sign. This 
problem can be studied in two different ways: either by 
means of the switching function <i>(t) (as above) or using 
the function 9{t). Here 6{t) is defined as the angle of ro- 
tation of the adjoint vector v = (^2,1^3) — (^2,2:3) with 
respect to its initial position. By the definition of v, we 
obtain 



V2 = -(2u-|-r/2)u3 

7)3 — 2uv2 - (7 



r|[/99|2 



r + 7 
2 

)V3 



V2, 



(17) 



r|[/f |2 



with the initial conditions ^2(0) = — 2ux3(0) — 0.5(r -|- 
7)2:2(0) + r/2(l - 2:3(0)) and V3{0) = 2ua:2(0) - (7 + 
)x3(0)-(7-r|f/f |2). 
In figure m we illustrate the angle 6{t) as a function of 
time for the system without (figure (a)) and with (figure 
(b)) feedback. The times at which the control u can 
switch are marked by arrows. We found from figure[3]-(a) 



5 



that the two trajectories corresponding to u = ±1 may 
switch at same times when there is no feedback, resulting 
in symmetry in the optimal trajectories. This result is 
changed by the feedback as figure [3]-(b) shows, the two 
trajectories switch almost at different times. In addition, 
the trajectories can switch to apposite control when 9 > 
and ^ > or < and ^ < 0, this condition together 
with the results in figure 2] yield the switching points 
in time. Define sgng = sgn{9) — sgn(6), the allowed 
switching points in terms of sgng are plotted in figure [51 

IV. CONCLUSION 

For a dissipative two-level system, we have shown that 
the manipulation of stationary state by feedback is pos- 
sible. The dependence of the stationary state on the 
feedback has been calculated and discussed. The feed- 
back together with the open loop control can broaden 
the reachable set of the stationary state, which provides 
us a new method to prepare quantum states by relaxing 
the system to its equilibrium states. In addition to im- 
prove the control of stationary state, the feedback also 
affects the time-optimal control of a two-level dissipative 
quantum system. The optimal trajectories for the sys- 
tem with feedback are no longer symmetric, indicating 
that the optimal trajectory can not be determined by us- 
ing symmetry analysis. The switching points in time are 
also presented and discussed, which together with the an- 
alytical solutions to the dynamics in the Appendix yield 



the optimal trajectory for the open system. 
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APPENDIX: ANALYTICAL DETERMINATION 
OF THE DYNAMICS 

In this section, we solve analytically the dynamics of 
the system given by Eq.([7]). To simplify the expression, 
we rewrite the equations as 

X2 = ^22^2 + B2X^ + C2, 

X3 = AsX2 + B3X3 + C3, (18) 

where A2 = -^^,^2 = -2u - r/2, C2 = r/2, ^3 = 
2u, B3 = -(7 + r|C/f and C3 = -(7 - r|C/f p). We 
assume that u = ±1, simple algebra gives the exact so- 
lutions to Eq. (fT8| . 

X2{t) = L' + M'e"2* + 7V'e"3*, 

X3{t) =L + Me"^* + iVe"^*, (19) 

where 



L' 



M' 



^2,^3= ±^V(^2+i33)^-4(A2i?3-^3i?2), (20) 

C3^2 — C2B3 



A2B3 — A3B2 

L'{A2 + B3) + ^2x3(0) - 53x2(6) + C2 + ix2{0) - L')a2 



Q!2 - a3 

N' = X2i0) -L' -M', (21) 

^3^*2 — A2C3 



A2B3 — A3B2 ' 

^ L{A2 + ^3) - ^2x3(0) + A3X2(0) + C3 + (.X3(0) - L)a2 

a2 — a3 

N = X3{0) -L-M, (22) 
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